Since previous work showed that it is difficult to forecast dry spells in Malawi, this document explores the option of using monthly precipitation as a proxy for the occurrence of dry spells and the forecasting skill for monthly precipitation. The precipitation patterns differ per region in Malawi. Since 41 out of 44 month-admin2 combinations with a dry spell occurred in the Southern region, this analysis solely focuses on this region to prevent weakening of signals due to the differences in climates between the regions. All the code used to produce this analysis is openly available here.
This analysis
The figure below shows the monthly precipitation, colored by whether a dry spell started during that month. From this figure we can see that
We can see that precipitation patterns clearly differ by month, which is expected. Moreover, the figures show that the separability of the occurrence of a dry spell differs by month. This becomes more clear when looking at a boxplot
In order to use the monthly precipitation as a proxy for the occurrence of a dry spell, we need to set a threshold on the amount of monthly precipitation. I.e. if the precipitation is forecasted to be lower than X, we trigger and else we don’t.
One method to get a sense for this, is by investigating a range of thresholds, and for each of them looking at the percentage of months with a dry spell that are below the threshold, and the percentage of months without a dry spell that are above the threshold. This is shown in the figure below. The figure shows that the trade-off between sensitivity and specificity depends on the month. Moreover, there is better separability during January and February than during December.
NOTE: false alarms is here FP/(FP+TN)! So not FP/(FP+TP)!
Since a trigger becomes too complex when setting a threshold for each month separately, we decide to set one threshold for all months. This is chosen by choosing the intersection of the two lines computed over all months, which is at 170mm. The graph below illustrates this.
To further understand the co-occurrence of low amounts of monthly precipitation and dry spells, it is important to look at the temporal distribution. To do so, the below figure shows a heatmap indicating the months with less than 170 mm of precipitation and the occurrence of dry spells. From this figure we can conclude that 6 out of the 7 dry spells co-occurr with <=170 mm monthly precipitation. It also becomes clear that <=170 mm monthly precipitation occurs in years that no dry spell was identified. Thus, with this threshold one would trigger more often than the occurrences of dry spells.
To conclude, the confusion matrix with a threshold of 170 mm is as follows. Thus 86% of the dry spells would be identified, and in 33% of the months with less than 170 mm of precipitation, a dry spell occurred.
Within this pilot, the accepted definition of a dry spell is that of <=2mm cumulative precipitation during 14 consecutive days. However, observational and forecast products often have trouble detecting such small amounts of rainfall and therefore many practitioners before us have defined dry spells based on dry days. Meaning that a dry spell consists of at least 14 consecutive dry days. The definition of a dry day differs between projects, but we take a commonly used definition of 4mm/day.
NOTE: these numbers are missing the dry spells outside the rainy season, which causes two dry spells in December to not be included!
We compute the same analysis with this different definition, and find that the optimal threshold is also at 170mm. As shown below.
From the heatmap we can conclude that due to the change of definition there is one more occurrence of a dry spell during February. During this month the precipitation was not lower than 170. However, we cannot properly compare the two definitions since the dry spells outside the rainy season are missing.
When looking at the confusion matrix, we can see a similair pattern. Due to the missed dry spell in February, 83% of the dry spells would have been identified, and in 28% of the months with less than 170 mm of precipitation, a dry spell occurred.
To support our discussion on severity, here is the heatmap on admin2 with <=2mm cumulative rainfall. This also includes the dry spells that have less than 7 days within the given month.
This image shows the resolution of ECMWF’s forecast. Due to the low resolution combined with the high uncertainy of long-term forecasts, we should look at admin1 and not admin2